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(54) IMAGE PROCESSING UNIT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To attain sharp image processing without distortion by 
eliminating block distortion by smoothing processing and applying edge emphasis 
processing to an edge substantial to an image on a block border. 
SOLUTION: A noted picture element and picture elements a-i in the vicinity of the 
noted picture element are obtained by 1 —line delay circuits 12 delaying an input signal 
and 1 -picture element delay circuits 345678. An edge detection circuit 9 obtains a 
level difference between the noted picture element (e) and picture elements a-dand 
f-i in the vicinity of the noted picture element. When all of level differences are 
smaller than the threshold levela smoothing filter 12 is selected for the processing. 
When a level difference with respect to the picture elements in the vicinity of the 
noted picture element in a direction orthogonal to the block border exceeds the 
threshold levelthe processing of selecting an edge emphasis filter 13 is conducted. 



CLAIMS 



[Claim(s)] 

[Claim 1]In an image processing device which decrypts picture information by which 
block coding was carried outa case where a noticed picture element is set as a block 
border — (1) — data smoothing with a noticed picture element on (2) block 
borderswhen all the absolute values of a signal level difference of the noticed picture 
element and neighborhood picture element of the circumference are smaller than a 
threshold defined beforehand. When a level difference with a neighborhood picture 



element which tends to intersect perpendicularly to a block border surpasses a 
thresholdedge enhancement processing(3) An image processing device performing 
data smoothing between a noticed picture element and a pixel whose level difference 
is smaller than a threshold when there is a level difference which surpasses a 
threshold between the other neighborhood picture elements. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application]This invention relates to the image processing device which 
decrypts the picture signal by which conversion coding was carried out by the block 
unitremoves the block distortion generated especially by codingand it relates to the 
device which performs edge enhancement. 
[0002] 

[Description of the Prior Art]Conventionallyin the coding mode of a picture signala 
picture signal is divided into two or more blocksand the block encoding system which 
codes image data by DCT (discrete cosine transform) etc. about each block is used 
well. In such a block encoding systembetween adjoining blocksa discontinuous level 
difference and what is called block distortion occurredand deterioration of image 
quality was caused. 

[0003]The device which smooths a decoded image over the whole screen is proposed 
for removal of this block distortion. Howeverwith this devicein order to process to the 
whole screeneven the edge data which picture original has were smoothedand there 
was a problem that sharpness fell. 

[0004]Thereforethis block distortion is removed and the image processing device 
which saves the edge data which an original image moreover has is proposed. The 
device is an edge preservation type block distortion stripper which performs data 
smoothingwhen block distortion is detected about the adjacent pixel of a block border 
and there is block distortion. 

[0005]At the place distant from the low pass filter and the block border in the block 
borderwhile removing block distortion by making a highpass filter actthe device which 
emphasizes edge is also proposed. 
[0006] 

[Problem(s) to be Solved by the Invention]Howeversince it can only perform 
performing processing which saves the original edge of a picture in the conventional 
deviceor making a low pass filter act in a block boundary partand performing a block 
distortion solvent wiping removalWhen edge was in a block borderprocessing which 
emphasizes bordering edge was not completed. Even if it performed processing which 
raises the sharpness of a picture with a highpass filtersince processing was 



impossibleit had the technical problem that data became discontinuous in a block 
boundary part and the block border exterior in the block border. 
[0007]Thenthis invention removes block distortion by data smoothing to block 
distortion in a block boundary partand an object of this invention is to perform sharp 
and distorted image processing which is not by performing edge enhancement 
processing to the original edge of a picture on a block border. 
[0008] 

[Means for Solving the Problem]In order to solve an aforementioned problem an image 
processing device of this inventiona case where a noticed picture element is set as a 
block border — (1) — data smoothing with a noticed picture element on (2) block 
borderswhen all the absolute values of a signal level difference of the noticed picture 
element and neighborhood picture element of the circumference are smaller than a 
threshold defined beforehand. When a level difference with a neighborhood picture 
element which tends to intersect perpendicularly to a block border surpasses a 
thresholdedge enhancement processing(3) When there is a level difference which 
surpasses a threshold between the other neighborhood picture elementsbe made to 
perform data smoothing between a noticed picture element and a pixel whose level 
difference is smaller than a threshold. 
[0009] 

[Function]performing edge enhancement processing to the edge which since an image 
book has in a block border according to the above-mentioned composition — a block 
— it will receive distortedblock distortion will be removed and sharp and distorted 
image processing which is not can be realized. In the block border exteriorif it is made 
to make the same edge enhancement filter as the former actthe continuity of data 
can be maintained by a boundary part. 
[0010] 

[Example] Hereafterthe example of the image processing device of this invention is 
concretely described with reference to drawings. Drawing 1 is a block diagram 
showing the composition of the image processing device in the example of this 
invention. The pixel value aband c of a noticed picture element and its neighborhood 
picture elementdefghand i are obtained by the 1 line delay circuit 1 and the 2 or 1- 
pixel delay circuits 34567and 8 which delay an input signal. If the horizontal direction 
of image data is made into an X coordinateit is perpendicularly made into a Y 
coordinate and the XY coordinates of an input signal are set to (x+1y+1)As for the 
coordinates of the output value of the 1 line delay circuits 1 and 2the XY coordinates 
of the output value of (x+1y)(x+1y-1)and the 1 -pixel delay circuits 34567and 8 are set 
to (x-1y+1)(xy)(x-1y)(y-x1)and (x-1y-1)respectively (y+x1 The coordinates of a pixel 
and the relation of a pixel value are shown in drawing 2 . 

[001 1]Paying attention to the pixel of coordinates (xy)the case where this noticed 
picture element is in a block border is described. It is detected in the picture element 
position detector circuit 15 whether a noticed picture element is in a block border. In 



the edge detection circuit 9the absolute value of the level difference of a noticed 
picture element and the neighborhood picture element of the circumference is 
computedand the existence and the edge position information on edge are sent to the 
filter selection signal generation circuit 10 as compared with the threshold defined 
beforehand. 

[0012]In the filter selection signal generation circuit 10when there is no edge which 
surpasses a thresholdthe signal which chooses the smoothing filter 12 is sent to the 
selection circuitry 14. When the level difference which surpasses a threshold is 
between the neighborhood picture elements of the direction which intersects 
perpendicularly with a block borderthe edge enhancement filter 13 is chosen. When 
there is edge which surpasses a threshold between the other neighborhood picture 
elementsthe smoothing filter 12 is chosenbut an average with a noticed picture 
element and the pixel group which edge has not generated is taken by the smooth 
pixel selection circuit 1 1 in that case. 

[0013]Since it can smooth maintaining edge when it becomes possible when the 
original edge of a picture is on a block border to give edge enhancement unlike the 
former and block distortion has occurred by the above compositionthe fall of 
sharpness can be made into the minimum. 

[0014]The selection method of a filter is shown below more concretely. Drawing 3 
expresses the physical relationship of pixel arrangement and the block border 16. The 
position of a noticed picture element and a neighborhood picture element in case a 
noticed picture element is in a block border is shown by 17. In this casea block border 
will be between x on an X coordinateand x+1. The algorithm which chooses a 
smoothing filter or an edge enhancement filter from the level difference of a noticed 
picture element and a neighborhood picture element is as follows. 
[0015]The level difference L1 of a noticed picture element and a neighborhood picture 
elementL2L3L4L5L6L7and L8 are computed first in the edge detection circuit 9. Each 
level difference value becomes L1=|e-a|L2=|e-b|L3=|e-c|L4=|e-d|L5=|e-f|L6=|e- 
g|L7=|e-h|and L8=|e-i|. The level difference of a noticed picture element and the 
neighborhood picture element which tends to intersect perpendicularly to a block 
border is set to L5 here. If the threshold which judges whether it is edge is set to Ta 
filter will be chosen from the relation between a level difference and threshold T as 
follows. 

(1) If it L5 >=T Becomesit will be an edge enhancement filter. 

(2) L5<T and L1 — < — TL2<TL3<Tand L4 — < — TL6<Tand L7<T — and — if it 
L8<T becomes — a smoothing filter. 

(3) L5<T — and (L1>=TL2>=TL3>=TL4>=TL6>=TL7>=Tor L8>=T) — if it becomes — 
a smoothing filter. Howevera pixel with the level difference which surpassed threshold 
T in this case is not added to calculation of data smoothing. 

[0016]The above processing is made in the filter selection signal generation circuit 
10and a filter selection signal is sent to the selection circuitry 14.In the above (3)the 



pixel to smooth is chosen in the smooth pixel selection circuit Hand it performs 
weighting to a smoothing filter. When there is no noticed picture element in a block 
borderthe filter selection signal generation circuit 10 chooses the edge enhancement 
filter 13and emphasizes edge. 

[0017]The circuitry of the above-mentioned smoothing filter and an edge 
enhancement filter is explained concretely. The smoothing filter 12 at the time of [ all 
the ] making pixel selection is shown in drawing 4 (a)and the example of composition 
of the edge enhancement filter 13 is shown in drawing 4 (b). The circuitry of drawing 5 
and the edge enhancement filter 1 3 is shown for the circuitry of the smoothing filter 
12 in drawing 6 . 

[0018]As the smoothing filter 12 shows to drawing 5 To the pixel which performs 
smoothing selected with the smooth pixel selection signalthe multipliers 
1820222426272931and 33 which carry out the multiplication of the coefficient shown 
in drawing 4 (a) are chosen by the selectors 35363738394041 and 42Edge chooses the 
multipliers 19212325283032and 34 which carry out the multiplication of 0 as the pixel 
which was not been and chosen by a selector. The signal by which multiplication was 
carried out is added with the adding machine 43. Since it is necessary to adjust a gain 
with the number of selections of a smooth pixelthe selected pixel number is counted 
at the counter 44the amount of gain adjustments is calculated by the multiplier 
computer 45and the multiplier 46 performs a gain adjustment. 

[0019]In the edge enhancement filter 13as shown in drawing 6t he multiplication of the 
coefficient shown in drawing 4 (b) to an input pixel signal is carried out with the 
multipliers 4748495051 525354and 55and it adds with the adding machine 56. 
[0020] 

[Effect of the Inventionjsetting to a block border as mentioned above according to 
this invention — a block — performing edge enhancement processing to the edge 
which since the image book which is not related distorted has — a block — it will 
receive distortedsmoothing will remove block distortionand sharp and distorted image 
processing which is not can be realized. In the block border exteriorsince the same 
edge enhancement processing as the above is performedthe continuity of data is 
maintained by a boundary part. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The block diagram showing the image processing device in the example of 
this invention 

[Drawing 2] The figure showing the pixel value and coordinates in the example 
[Drawing 3] The figure showing the pixel arrangement in the exampleand the position 
of a block border and a reference pixel group 



[Drawing 4] The lineblock diagram of the smoothing filter in the exampleand an edge 
enhancement filter 

[Drawing 5] The smoothing filter circuit diagram in the example 
[Drawing 6] The edge enhancement filter circuit diagram in the example 
[Description of Notations] 

I and 2 1 line delay circuit 
34567and 8 1 -pixel delay circuit 

9 Edge detection circuit 

10 Filter selection signal generation circuit 

I I Smooth pixel selection circuit 

12 Smoothing filter 

13 Edge enhancement filter 

14 Selection circuitry 

1 5 Picture element position detector circuit 

16 Block border 

17 A noticed picture element and a neighborhood picture element position 
181 92021 22232425262728293031 323334 multipliers 
35363738394041 and 42 Selector 

43 Adding machine 

44 Counter 

45 Multiplier computer 

46 Multiplier 

4748495051 525354and 55 Multiplier 
56 Adding machine 
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